Grid Services for Fast Retrieval on Large Multidimensional Databases
نویسنده
چکیده
Fast, user-centric access to and evaluation of large supercomputing results is a well-recognised problem among compute and data service providers. In the ESTEDI initiative, research and industry from Europe and beyond cooperate to overcome this obstacle. The basic approach is to augment the highvolume data generators with a database system for the management and extraction of spatio-temporal data. Led by ERCOFTAC (European Research Community on Flow, Turbulence and Combustion), a detailed requirements analysis has been carried out which forms the basis for the specification of a High-Performance Computing (HPC) database platform. Implementation of this platform relies on the multidimensional database system RasDaMan. Evaluation covers all major application fields by HPC centres with in-depth experience in their resp. field. We introduce the ESTEDI project and give an overview of the data management platform under development.
منابع مشابه
Spatial Indexing of Large Multidimensional Databases
Scientific endeavors such as large astronomical surveys generate databases on the terabyte scale. These, usually multidimensional databases must be visualized and mined in order to find interesting objects or to extract meaningful and qualitatively new relationships. Many statistical algorithms required for these tasks run reasonably fast when operating on small sets of in-memory data, but take...
متن کاملGrid-based Clustering in the Content-based Organization of Large Image Databases
In the image databases, there is often a need to organize the images automatically by their content. For the content-based organization of the images, clustering operations can be applied. We present a new, efficient method for the clustering of large image databases. The method is based on hierarchical clustering of the image database using grid. In this paper, the grid-based clustering method...
متن کاملAnalysis and Validation of Information Access Through Mono, Multidimensional and Dynamic Taxonomies
Access to complex information bases through multidimensional, dynamic taxonomies (also improperly known as faceted classifications) is becoming a hot concept both in research and in industry. In this paper, the major shortcomings of conventional, monodimensional taxonomic approaches, such as the independence of different branches of the taxonomy and insufficient scalability, are discussed. The ...
متن کاملAn Efficient Data Replication Strategy in Large-Scale Data Grid Environments Based on Availability and Popularity
The data grid technology, which uses the scale of the Internet to solve storage limitation for the huge amount of data, has become one of the hot research topics. Recently, data replication strategies have been widely employed in distributed environment to copy frequently accessed data in suitable sites. The primary purposes are shortening distance of file transmission and achieving files from ...
متن کاملIndexing by Shape of Image Databases Based on Extended Grid Files
In this paper, we propose an original indexing by shape of image databases based on extended grid files. We first introduce a recently developed shape description method and tailor it to obtain suitable representation structures for image databases. Then, in order to efficiently support image retrieval, we define an indexing structure based on grid files. Since grid files were originally develo...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001